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Abstract 

In this study, we rederive the fluctuation theorems in presence of feedback, by assuming the known 
Jarzynski equality and detailed fluctuation theorems. We first reproduce the already known work theorems 
for a classical system, and then extend the treatment to the other classical theorems. For deriving the 
extended quantum fluctuation theorems, we have considered open systems. No assumption is made on 
the nature of environment and the strength of system-bath coupling. However, it is assumed that the 
measurement process involves classical errors. 
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1 Introduction 

In the last couple of decades, active research is being 
pursued in the field of nonequilibrium statistical me- 
chanics. Until recently, the systems that are far from 
equilibrium had always eluded exact analytical treat- 
ments, in contrast to the well-established theory in 
the linear response regime. Several new results have 
been discovered for systems that are far from equilib- 
rium. These relations are generically grouped under 
the heading fluctuation theorems [I]-[5]. One of the 
major breakthroughs has been the Jarzynski Equal- 
ity [3J, which states the following. Suppose that the 
system, consisting of a Brownian particle, is initially 
prepared in canonical equilibrium with a heat bath at 
temperature T. Now we apply an external protocol 
A(i) that drives the system away from equilibrium. 
The following equality provided by Jarzynski is valid 
for this system [3J: 
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Here, W is the thermodynamic work defined by W = 
$I(dH\/d\)\ dt. H\ is the Hamiltonian with exter- 
nally controlled time-dependent protocol A(t), and r 
is the time for which the system is driven. AF is 
the difference between the equilibrium free energies 
of the system at the parameter values A(0) and A(r), 
which equals the work done in a reversible process. 
A direct outcome of the above equality is the second 
law of thermodynamics, which states that the aver- 
age work done on a system cannot be less than the 
change in free energy: (W) > AF. A further general- 
ization of the above result was provided by Crooks |4] . 
The Crooks' work theorem says that the ratio of the 
probability of the performing work W on the sys- 
tem, Pf(W), along the forward process and that of 
performing work —W (i.e., extracting work from the 
system) along the time-reversed process, P r {— W), is 
exponential in the forward work, provided the initial 
state of either process is at thermal equilibrium: 
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Here, the initial probability density function (pdf) of 
the time-reversed process is the thermal/Boltzmann 
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pdf corresponding to the final protocol value A(r) 
of the forward process. It is crucial to note that the 
fluctuation theorems are in complete conformity with 
the second law, since the average work always exceeds 
the free energy, although for individual trajectories 
this condition may not be meted out [5J. 

The above theorems are valid for what are known 
as open-loop feedback, i.e., when the protocol func- 
tion for the entire process is predetermined. In con- 
trast, in a closed-loop feedback, the system state is 
measured along the forward trajectory, and the pro- 
tocol is changed depending on the outcomes of these 
measurements. For such feedback-controlled systems, 
the fluctuation theorems need modifications so as to 
account for the information gained through measure- 
ment. Sagawa and Ueda have derived these extended 
relations for both the classical 018] and the quan- 
tum [5] cases. In the original papers, a single mea- 
surement (at some instant t = t m ) was considered. 
Subsequently, in a detailed review [8], the authors 
have derived the relations in the classical case, when 
multiple measurements are being performed. 

In this paper we rederive the results for the classical 
systems, assuming the known fluctuation theorems 
in their integral as well as detailed form. The same 
treatment goes through for deriving the generalized 
Hatano-Sasa identity, which provides equalities for a 
driven system from one steady state to another. We 
also extend the same treatment to the quantum case, 
and show that no matter how many intermediate pro- 
jective measurements and subsequent feedbacks are 
performed, the extended Tasaki-Crooks fluctuation 
theorem remains unaffected. The efficacy parameters 
for classical and quantum systems are also obtained. 
We believe that our treatment is simple, as it assumes 
the already known Jarzynski Equality and the other 
fluctuation theorems in the absence of feedback. 

2 The System 

We have a Brownian particle that is initially prepared 
in canonical equilibrium with a heat bath at temper- 
ature T. Now, we apply an external drive Ao(t) from 
time to = up to t = t%. At ti, we measure the 
state of the system and find it to be mi (see fig- 



ure [T]). Then, we modify our protocol from Ao(i) to 
A mi (t) and evolve the system up to time ti , where 
we perform a second measurement with outcome mi . 
Subsequently the protocol is changed to X rn2 (t), and 
so on up to the final form of the protocol X mN (t), 
which ends at t — r (total time of observation). How- 
ever, the time instants at which such measurements 
are taken need not be equispaced. We assume that 
there can be a measurement error with probability 
p(nik\xk), where rrifc is the measurement outcome at 
time tk, when the system's actual state is Xk- Obvi- 
ously, the value of AF will be different for different 
protocols X mk (t). 




Figure 1: A typical phase space trajectory x{t) vs t. 
The actual and the measured states at time tk are Xk 
and m/c, respectively. 



3 Extended Jarzynski Equality 

For a given set of observed values {m^} = 
{mi, ma, ■ • • , rnjsr}, we have a fixed protocol 
{X mk (t)} which depends on all the measured values 
{rrik}, as explained above. For such a given protocol 
trajectory, the Jarzynski Equality must be satisfied. 
Eq. ([1]) can be rewritten as 

J V[x{t)] Peq (x ) P { x mk Mt)\x ] 

xexp{-pW[x(t),{m k }] + pAF(\ mN (T))} = 1, 

(3) 

where p e q{xo) is the equilibrium distribution of 
the system at the beginning of the protocol, 
Ps\ \[x{i)\xo] is the path probability (from given 
initial point xq) for this fixed protocol, and W is a 
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function of the path. Now we average over all possible 
protocols: 



{dm k }P[{m k }} J V[x{t)] Peq (x ) P {Xmk} [x(t)\x ] 

xexp{-pW[x(t),{m k }]+0AF(\ mN {r))} = 1. 

(4) 

Here, {dm k } = dm\dm 2 ■ ■ • dm^, and P[{mfc}] is the 
joint probability of a set of measured values {m k }. 
The mutual information is dchned as jlOj 



J = ln 



p{mi\xi) p{m 2 \x 2 ) ■■■ p{m N \x N ) 
P[{m k }} 



(5) 



The path probability P{\ m y[x(t)\xo] for a fixed pro- 
tocol and fixed xq is given by 



Pi 



\x mk }[x(t)\x ] =P\ [x -> xx] P\ mi [x\ 
Using © and © in (TTJ, we get 



X 2 \ 



(0) 



{dm k } J V[x(t)]p eq (x ) P\ [x xj] 

x p(mx\xi) P Xmi [x\ -)• x 2 ] 
■ ■ ■ p(m N \x N ) P Amjy [x N -s- x T ] 
x exp{-pW + f3AF - 1} = 1. (7) 

To keep the notations simple, the arguments of W, 
AF and / have been omitted. The joint probability 
for a phase space trajectory x{t) and measured values 
{m k } in forward process (for any initial point xq) is 

P{>.m k }i X ( t )>{' m k}} =Peq{xo) P\ [XO -> Xl] 

x p(mi\x\) P\ m% [xi -> x 2 ] ■■■ 

X p(m N \x N ) P\ mN [xN ->X T ]. (8) 

This is precisely the factor appearing before 
e -p(w-\F~i) j n |_ ne integrand in ([7]). Thus we arrive 
at the following generalized Jarzynski Equality: 



-P(W-AF)-I 
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The Jensen's inequality leads to the second law of 
thermodynamics which is generalized due to infor- 
mation gain, namely, {W) > {AF} — IcbT(I}. Since 



(I) > (being a relative entropy), work performed on 
a thermodynamic system can be lowered by feedback 
control. 

4 Detailed Fluctuation Theo- 
rem 

The probability of forward path is given by (jHJ. To 
generate a reverse trajectory, we first select one of 
the measurement trajectories {m k } (with probability 
P[{ TO fc}])- We then begin with the system being at 
canonical equilibrium at the final value of the proto- 
col A mjv (r), and blindly run the full forward protocol 
in reverse, i.e., {X k {t)} -> {a£(*)} = {X k (r-t)}. We 
stress that no feedback is performed during the re- 
verse process in order to respect causality [lOj . In 
this case, the probability of a reverse trajectory be- 
comes 



P { xl k} [^(t)-{m k }} = P[{m k }] P A t[4 <- 4} 

<- 4l • • ' P A+ \- X N *~ 4] Peq(Xr)- 

(10) 



Pr A t i {mfc}] should not be confused with 

the joint probability P^ x \ , \x'(t), {mfc}]. The for- 
mer represents the probability of the reverse path 
with fixed values {m k } multiplied by the probability 
P[{ m k}} of choosing the set {m k }, while the latter 
represents the probability of a trajectory x(t) along 
with the measured outcomes {m k }, if measurements 
are performed along the reverse process. Now we take 
the ratio of (151) and (TlOl): 



P{x mk }[x(t),{m k }] P { x mk }[x(t)} 



P {xLk} [xHt);{m k }} P {xLk} [xt(t)} 

P(mi\xi) p(m 2 \x 2 ) ■■■ p{m N \x N ) 
P[{m k }} 



(11) 



where we have used the known Crooks' work theorem 
(for a predetermined protocol) [IJ[5], 



P{x mk Mt)} 



= e 0(W-AF) 



(12) 



3 



and the definition of mutual information (eq. ©). 
Thus we obtain the modified detailed fluctuation the- 
orem in presence of information, 



p jx mk }[x(t)A m k}} 

{At } [xt(0;{m fc }] 



/3(W-AF)+I 



P 



(13) 



5 Modification in Seifert's and 
Hatano-Sasa identities 

Now we derive other identities which are straightfor- 
ward generalizations of their earlier counterparts, in 
the presence of information. The mathematics in- 
volved is the same as in sections [3] and 01 For a pre- 
determined protocol, if the pdf of the initial states 
for the forward path (denoted by po(xo)) are arbi- 
trary rather than being the Boltzmann distribution, 
and that of the reverse path is the final distribution 
of states (denoted by p T (x T )) attained in the forward 
path, we obtain the Seifert's theorem in lieu of the 
Jarzynski equality [TTII12J : 



-Astot 



>=1- 



(14) 



Here, As tot = As m + As is the change in the total 
entropy of bath and system. The path-dependent 
medium entropy change is given by As m = Q/T, 
where Q is the heat dissipated into the bath. As 
is the change in the system entropy given by As = 
\o[pq{xq) / p T (x T )]. Then eq. (|14l) can be written as 



V[x(t)] Po (x ) P {Xmk} [x(t)\x ] 

x exp{-As tot [a;(t)]} = 1, (15) 



Averaging over different sets of protocols deter- 
mined by the different sets of {m^} values, we get 



{dm k }P[{m k }] J V[x{t)] p (x ) P {Xmk} [x(t)\x Q ] 
x exp{-As tot [x(t)]} = 1. (16) 



Proceeding exactly in the same way as in section [3] 
(eqns. (P)-©), we readily get 



-As tot -7\ 



(17) 



Eq. dT7| is the generalization of the entropy produc- 
tion theorem and it gives the second law in the form 



(As tot ) >-(/). 



(18) 



Thus with the help of information (feedback), the 
lower limit of change in average entropy can be made 
less than zero, by an amount given by the average 
mutual information gained. We can similarly show 
that in steady states, the detailed fluctuation theo- 
rem for total entropy becomes 



P{As tot ,I) 
P(- A Stot , I) 



_ e As tot +I 



(19) 



Here, P(Astot,I) is the joint probability of the 
change in total entrop Astot and mutual informa- 
tion / along the forward path. P(—Astot, I) i s the 
total probability of reverse trajectories along which 
the change in total entropy is —Astot, and whose 
corresponding forward trajectories have the mutual 
information / between the measured and the actual 
states (see [T3] for details). 

The Hatano-Sasa identity []3] can also be similarly 
generalized: 



exp 



dtX — ^ 1 

OA 



1. 



(20) 



where <fi(x, A) = — In p ss (x, A), the negative logarithm 
of the nonequilibrium steady state pdf correspond- 
ing to parameter value A. The derivations of flT9l 
and (|20[) are simple and similar to the earlier deriva- 
tions (see sections [3] and Hj) , so they are not repro- 
duced here. In terms of the excess heat Q ex , which 
is the heat dissipated when the system moves from 
one steady state to another, the above equality (eq. 
([20]) ) can be rewritten in the following form (for de- 
tails see [14]): 



(e X p[-PQex ~ A0 - I}) = 1. 



(21) 



Using the Jensen's inequality, the generalized second 
law for transitions between nonequilibrium steady 
states follows, namely, 



T(As) > —(Qex) - k B T{I), 



(22) 



where As is the change in system entropy defined by 
As = -ln M a 'M =A6. 

p aa {x,\ ) 
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6 The generalized Jarzynski 
equality and the efficacy pa- 
rameter 

The Jarzynski equality can also be extended to a dif- 
ferent form in the presence of information: 

(e -/3(W-AF) ) = ^ (23) 

where 7 is the efficacy parameter [7JIH]- The efficacy 
parameter 7 defines how efficient our feedback con- 
trol is. Following similar mathematical treatment as 
in the derivation of extended Jarzynski equality, we 
have 

-@(w-AF) 



7= / V[x{t)]{dm k }P {Xmk} [x{t),{m k }y 

V[x(t)}{dm k }P {xlj [x\t);{m k }} e 1 . (24) 

In the last step we have used relation (fT3|) . Using the 
definition (fTU|) for the reverse trajectory and eq. (|5|) 
for the mutual information, we get 

7 = J V[x{t)]{dm k }P[{m k }] P A +[4 <- x\] 

i X l <~ 4] • • • P \l N [ X N <~ X \] Peq(Xr) 

p{mi\xi) p(m 2 \x 2 ) •■• p(m N \x N ) . . 

P[{m k }\ 

Now we use the assumption of time-reversal sym- 
metry of the measurements [7], i.e., p(wl|4) — 
p(m k \x k ). This leads to 



7 = y V[x(t)]{dm k }P {xLk} [xHt)} 

x p(mj|x{) p(m\\x\) ■■■ p(rrv N \x\) 

V[xHt)] {dm k } P {xlk} [x^t),{ml}}. (26) 

Here, {jri^}] is the joint probability of 

obtaining both the trajectory x(t) and the set of mea- 
sured outcomes {wj.} in the reverse process under the 
protocol {A}„ }. Finally, performing the integral over 
the trajectories, we arrive at 



7 = J {dm k } P {xLk} [{m{}]. 



Here, P^ x \ is the probability of observing 

the measurement trajectory {ttt,^,} for the reverse pro- 
cess. Physically, this means that 7 also describes the 
sum of the probabilities of observing time-reversed 
outcomes in the time-reverse protocols, for all set of 
possible protocols. 

7 Quantum case 

Now we extend the above treatment to the case of a 
quantum open system. Hanggi et al have shown |15j 
that for a closed quantum system, the fluctuation 
theorems remain unaffected even if projective mea- 
surements are performed in-between. This happens 
in spite of the fact that the probabilities of the for- 
ward and backward paths (by "path" we mean here 
a collection of the successive eigenstates to which the 
system collapses each time a projective measurement 
is performed) do change in general. Taking cue from 
this result, we proceed as follows. The supersystem 
consisting of the bath and the system evolve under 
the total Hamiltonian 



H(t) = H s (t)+H SB +H B . 



(28) 



The bath Hamiltonian Hb and the interaction 
Hamiltonian Hsb have been assumed to be time- 
independent, whereas the system Hamiltonian Hs(t) 
depends explicitly on time through a time-dependent 
external drive X(t). We first prepare the supersystem 
at canonical equilibrium at temperature T. At initial 
time to = 0, we measure the state of the total sys- 
tem and the collapsed eigenstate is \io). The notation 
means that the total system has collapsed to the i h 
eigenstate (of the corresponding measured operator, 
which is the total Hamiltonian H(0) at t — 0) when 
measured at time t = 0. The supersystem consisting 
of the bath and the system is described by 



P(0) 



-PH{0) 



(29) 



(27) 



y(o) ™ 10 y(o) 

In the above relation, pi i are the diagonal elements 
of the initial density matrix of the supersystem, and 
Y(0) is the partition function for the entire supersys- 
tem: 

Y(0) = Tr e -P H{ °\ (30) 
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We then evolve the system up to time t\ under a 
predetermined protocol Ao(i), and at t\ we once again 
measure some observable M of the system. Let the 
outcome be mi, whereas the actual collapsed state 
is |ix) corresponding to eigenvalue M il . This out- 
come is obtained with probability p(mi\ii), which is 
an assumed classical error involved in the measure- 
ment. Now we introduce the feedback by modify- 
ing the original protocol to X mi (t), and then con- 
tinue up to where we perform the measurement 
to get outcome 7712, the actual state being |z 2 ). Sub- 
sequently our protocol becomes \ m2 (t), and so on. 
Thus the probability of getting the set of eigenstates 
{i k } = {\io),\ii), ■ ■ ■ , \i T )} with the measurement 
trajectory {rrik} is given by 

p {x mk }[{ik}A m k}} = Pi i |(ii|£/Ao0i,0)|i )| 2 
xp(mi\h) |(«2|^A mi (i2^i)|ji)| 2 x ••• 
xp(m N \i N ) \(i T \U\ mN (T,t N )\i N )\ 2 . (31) 

Here, U\ m . (it+ijij) is the unitary evolution operator 
from time tj to time ti + \. The reverse process is gen- 
erated by starting with the supersystem in canonical 
equilibrium with protocol value A mjv (r), and blindly 
reversing one of the chosen protocols of the forward 
process. Now wc need to perform measurements 
along the reverse process as well, simply to ensure 
that the state does collapse to specific eigenstates 
and we do obtain an unambiguous reverse trajectory 
in each experiment. However, in order to respect 
causality |10j , we do not perform feedback during the 
reverse process. The probability for a trajectory that 
starts from initial collapsed energy eigenstate \i T ) and 
follows the exact sequence of collapsed states as the 
forward process is given by 

p {x i k} l{*k};{m k }} = |<i |eti7 A t(o,ti)e|ii>| 2 
x [<*i|e+tr x t (iiJ 2 )e|; 2 >| 2 x ... 

x \(i N \&U xl {t Nl T)Q\i T )\ 2 p Mr P[{m k }}. 

(32) 

Here, is a time-reversal operator [151 . and 
|(ik|8 t Z7,t (t k ,t k+1 )Q\i k+1 )\ 2 is the probability of 

m k 

transition from the time-reversed state Q\i k +i) to 



Q\i k ) under the unitary evolution with the reverse 
protocol: U\ m Jt k ,t k+ i) = U\ mk (t - t k , r - t k +i). 
Here, the tilde symbol implies time calculated along 
the reverse trajectory: t = r — t. Pi T i T is the diagonal 
element of the density matrix when the system is at 
canonical equilibrium at the beginning of the reverse 
process: 

e -m T 

P lT%T = TTZ , ■ (33) 



Y(r) 



Now we have, 



etTexp 
Texp 



H x t (t)dt 
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(34) 



where T implies time-ordering. Changing the vari- 
able t — )■ t — t, we get 



Texp 



Texp 



i f th 

- H x f (r-t)dt 



H\ mk (t)dt 



(35) 



= u Xm At k ,t k+1 ) = u{ (t k+1 ,t k ). 

Accordingly, 

(tfcie^^t (t k ,t k +i)&\ik+i) 

m k 

= (h\Ut (t k+ i,t k )\i k+1 ) = (i k+ i\U Xmi {t k+ i,t k )\i k y . 

(36) 

Thus, while dividing (|3Tj) by (|32]l . all the modulus 
squared terms cancel, and we have, 

Pioio 

p(mi\h) ■ ■ -p{m N \i N ) 

P, 



Y(r) 
F(0) 



P[{m k }} 



(37) 



G 



where W = Ei T —Ei is the work done by the external 
drive on the system. This follows from the fact that 
the external forces act only on the system S. Now we 
follow [16j and define the equilibrium free energy of 
the system, Fg(t), as the thermodynamic free energy 
of the open system, which is the difference between 
the total free energy Fit) of the supersystem and the 
bare bath free energy Fb- 

F s (t) = F(t)-F B . (38) 

Here, t specifies the values of the external parameters 
in the course of the protocol at time t. From the 
above equation, the partition function for the open 
system is given by [TB] 

vm Tr e-^W 

Z s (t) = L^l= S £ (39) 
Z B ir e~P HB 

B 

where S and B represent system and bath variables, 
respectively. Since Zb is independent of time, using 
(J39J) in d3TJ) , we have 

P{^ k }[{ik}dm k }] = Z s (t) ePW+I = e0(w ^ AFs)+I 
P {xl y [{ik};{m k }] Z S {0) 

(40) 

The above relation is the extended form of the 
Tasaki-Crooks detailed fluctuation theorem for open 
quantum systems in presence of feedback where the 
measurement process involves classical errors. 

From (|40p. the quantum Jarzynski Equality fol- 
lows: 

= £ / { dm fc} P {A] rlfc }[^ fc J' ; { TOfc }] = l ' 
{ik} 

i.e., 

/- m -AF 3 )-l\ = L (41) 

This is valid for open quantum system and is inde- 
pendent of the coupling strength and the nature of 
the bath. 



The quantum efficacy parameter is defined as 
( e -P(W-AFs)^ = anc } tfie calculation of 7 is ex- 
actly in the spirit of section [HI except that J T>[x(t)] 
is replaced by J2{i k }> i- e -i summation over all possible 
eigenstates. Finally we get the same result, namely, 

7 = J{dm k }P {xlk} [{ml}}. (42) 

8 Discussion and conclusions 

In conclusion, we have rederived several extended 
fluctuation theorems in the presence of feedback. To 
this end, we have used several equalities given by the 
already known fluctuation theorems. We have ex- 
tended the quantum fluctuation theorems for open 
systems, following the earlier treatment [T5]|TB] . No 
assumption is made on the strength of the system- 
bath coupling and the nature of the environment. 
However, we have assumed that the measurement 
process leading to information gain involves classical 
errors. The fluctuation-dissipation theorem is vio- 
lated in nonequilibrium systems. The effects of feed- 
back on this violation are being studied |17) . This is 
the subject of our ongoing work. 
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